Neuronal Modeling of Cross-Sensory Visual Evoked Magnetoencephalography Responses in the Auditory Cortex.

Previous studies have demonstrated that auditory cortex activity can be influenced by cross-sensory visual inputs. Intracortical laminar recordings in nonhuman primates have suggested a feedforward (FF) type profile for auditory evoked but feedback (FB) type for visual evoked activity in the auditory cortex. To test whether cross-sensory visual evoked activity in the auditory cortex is associated with FB inputs also in humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex regions of interest, auditory evoked response showed peaks at 37 and 90 ms and visual evoked response at 125 ms. The inputs to the auditory cortex were modeled through FF- and FB-type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which links cellular- and circuit-level mechanisms to MEG signals. HNN modeling suggested that the experimentally observed auditory response could be explained by an FF input followed by an FB input, whereas the cross-sensory visual response could be adequately explained by just an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.

Neuronal modeling of magnetoencephalography responses in auditory cortex to auditory and visual stimuli.

Previous studies have demonstrated that auditory cortex activity can be influenced by crosssensory visual inputs. Intracortical recordings in non-human primates (NHP) have suggested a bottom-up feedforward (FF) type laminar profile for auditory evoked but top-down feedback (FB) type for cross-sensory visual evoked activity in the auditory cortex. To test whether this principle applies also to humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex region of interest, auditory evoked responses showed peaks at 37 and 90 ms and cross-sensory visual responses at 125 ms. The inputs to the auditory cortex were then modeled through FF and FB type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which consists of a neocortical circuit model linking the cellular- and circuit-level mechanisms to MEG. The HNN models suggested that the measured auditory response could be explained by an FF input followed by an FB input, and the crosssensory visual response by an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG/EEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.

Visual Stimuli Modulate Local Field Potentials But Drive No High-Frequency Activity in Human Auditory Cortex.

Neuroimaging studies suggest cross-sensory visual influences in human auditory cortices (ACs). Whether these influences reflect active visual processing in human ACs, which drives neuronal firing and concurrent broadband high-frequency activity (BHFA; >70 Hz), or whether they merely modulate sound processing is still debatable. Here, we presented auditory, visual, and audiovisual stimuli to 16 participants (7 women, 9 men) with stereo-EEG depth electrodes implanted near ACs for presurgical monitoring. Anatomically normalized group analyses were facilitated by inverse modeling of intracranial source currents. Analyses of intracranial event-related potentials (iERPs) suggested cross-sensory responses to visual stimuli in ACs, which lagged the earliest auditory responses by several tens of milliseconds. Visual stimuli also modulated the phase of intrinsic low-frequency oscillations and triggered 15-30 Hz event-related desynchronization in ACs. However, BHFA, a putative correlate of neuronal firing, was not significantly increased in ACs after visual stimuli, not even when they coincided with auditory stimuli. Intracranial recordings demonstrate cross-sensory modulations, but no indication of active visual processing in human ACs.

Neural representation of phonological wordform in bilateral posterior temporal cortex.

While the neural bases of the earliest stages of speech categorization have been widely explored using neural decoding methods, there is still a lack of consensus on questions as basic as how wordforms are represented and in what way this word-level representation influences downstream processing in the brain. Isolating and localizing the neural representations of wordform is challenging because spoken words evoke activation of a variety of representations (e.g., segmental, semantic, articulatory) in addition to form-based representations. We addressed these challenges through a novel integrated neural decoding and effective connectivity design using region of interest (ROI)-based, source reconstructed magnetoencephalography/electroencephalography (MEG/EEG) data collected during a lexical decision task. To localize wordform representations, we trained classifiers on words and nonwords from different phonological neighborhoods and then tested the classifiers' ability to discriminate between untrained target words that overlapped phonologically with the trained items. Training with either word or nonword neighbors supported decoding in many brain regions during an early analysis window (100-400 ms) reflecting primarily incremental phonological processing. Training with word neighbors, but not nonword neighbors, supported decoding in a bilateral set of temporal lobe ROIs, in a later time window (400-600 ms) reflecting activation related to word recognition. These ROIs included bilateral posterior temporal regions implicated in wordform representation. Effective connectivity analyses among regions within this subset indicated that word-evoked activity influenced the decoding accuracy more than nonword-evoked activity did. Taken together, these results evidence functional representation of wordforms in bilateral temporal lobes isolated from phonemic or semantic representations.

Abstract representations in temporal cortex support generative linguistic processing.

Generativity, the ability to create and evaluate novel constructions, is a fundamental property of human language and cognition. The productivity of generative processes is determined by the scope of the representations they engage. Here we examine the neural representation of reduplication, a productive phonological process that can create novel forms through patterned syllable copying (e.g. ba-mih → ba-ba-mih, ba-mih-mih, or ba-mih-ba). Using MRI-constrained source estimates of combined MEG/EEG data collected during an auditory artificial grammar task, we identified localized cortical activity associated with syllable reduplication pattern contrasts in novel trisyllabic nonwords. Neural decoding analyses identified a set of predominantly right hemisphere temporal lobe regions whose activity reliably discriminated reduplication patterns evoked by untrained, novel stimuli. Effective connectivity analyses suggested that sensitivity to abstracted reduplication patterns was propagated between these temporal regions. These results suggest that localized temporal lobe activity patterns function as abstract representations that support linguistic generativity.

No Differences in Auditory Steady-State Responses in Children with Autism Spectrum Disorder and Typically Developing Children.

Auditory steady-state response (ASSR) has been studied as a potential biomarker for abnormal auditory sensory processing in autism spectrum disorder (ASD), with mixed results. Motivated by prior somatosensory findings of group differences in inter-trial coherence (ITC) between ASD and typically developing (TD) individuals at twice the steady-state stimulation frequency, we examined ASSR at 25 and 50 as well as 43 and 86 Hz in response to 25-Hz and 43-Hz auditory stimuli, respectively, using magnetoencephalography. Data were recorded from 22 ASD and 31 TD children, ages 6-17 years. ITC measures showed prominent ASSRs at the stimulation and double frequencies, without significant group differences. These results do not support ASSR as a robust ASD biomarker of abnormal auditory processing in ASD. Furthermore, the previously observed atypical double-frequency somatosensory response in ASD did not generalize to the auditory modality. Thus, the hypothesis about modality-independent abnormal local connectivity in ASD was not supported.

Cortical depth profiles of auditory and visual 7 T functional MRI responses in human superior temporal areas.

Invasive neurophysiological studies in nonhuman primates have shown different laminar activation profiles to auditory vs. visual stimuli in auditory cortices and adjacent polymodal areas. Means to examine the underlying feedforward vs. feedback type influences noninvasively have been limited in humans. Here, using 1-mm isotropic resolution 3D echo-planar imaging at 7 T, we studied the intracortical depth profiles of functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) signals to brief auditory (noise bursts) and visual (checkerboard) stimuli. BOLD percent-signal-changes were estimated at 11 equally spaced intracortical depths, within regions-of-interest encompassing auditory (Heschl's gyrus, Heschl's sulcus, planum temporale, and posterior superior temporal gyrus) and polymodal (middle and posterior superior temporal sulcus) areas. Effects of differing BOLD signal strengths for auditory and visual stimuli were controlled via normalization and statistical modeling. The BOLD depth profile shapes, modeled with quadratic regression, were significantly different for auditory vs. visual stimuli in auditory cortices, but not in polymodal areas. The different depth profiles could reflect sensory-specific feedforward versus cross-sensory feedback influences, previously shown in laminar recordings in nonhuman primates. The results suggest that intracortical BOLD profiles can help distinguish between feedforward and feedback type influences in the human brain. Further experimental studies are still needed to clarify how underlying signal strength influences BOLD depth profiles under different stimulus conditions.

Neural evidence suggests phonological acceptability judgments reflect similarity, not constraint evaluation.

Acceptability judgments are a primary source of evidence in formal linguistic research. Within the generative linguistic tradition, these judgments are attributed to evaluation of novel forms based on implicit knowledge of rules or constraints governing well-formedness. In the domain of phonological acceptability judgments, other factors including ease of articulation and similarity to known forms have been hypothesized to influence evaluation. We used data-driven neural techniques to identify the relative contributions of these factors. Granger causality analysis of magnetic resonance imaging (MRI)-constrained magnetoencephalography (MEG) and electroencephalography (EEG) data revealed patterns of interaction between brain regions that support explicit judgments of the phonological acceptability of spoken nonwords. Comparisons of data obtained with nonwords that varied in terms of onset consonant cluster attestation and acceptability revealed different cortical regions and effective connectivity patterns associated with phonological acceptability judgments. Attested forms produced stronger influences of brain regions implicated in lexical representation and sensorimotor simulation on acoustic-phonetic regions, whereas unattested forms produced stronger influence of phonological control mechanisms on acoustic-phonetic processing. Unacceptable forms produced widespread patterns of interaction consistent with attempted search or repair. Together, these results suggest that speakers' phonological acceptability judgments reflect lexical and sensorimotor factors.

Magnetoencephalography and electroencephalography can both detect differences in cortical responses to vibrotactile stimuli in individuals on the autism spectrum.

Autism Spectrum (AS) is defined primarily by differences in social interactions, with impairments in sensory processing also characterizing the condition. In the search for neurophysiological biomarkers associated with traits relevant to the condition, focusing on sensory processing offers a path that is likely to be translatable across populations with different degrees of ability, as well as into animal models and across imaging modalities. In a prior study, a somatosensory neurophysiological signature of AS was identified using magnetoencephalography (MEG). Specifically, source estimation results showed differences between AS and neurotypically developing (NTD) subjects in the brain response to 25-Hz vibrotactile stimulation of the right fingertips, with lower inter-trial coherence (ITC) observed in the AS group. Here, we examined whether these group differences can be detected without source estimation using scalp electroencephalography (EEG), which is more commonly available in clinical settings than MEG, and therefore offers a greater potential for clinical translation. To that end, we recorded simultaneous whole-head MEG and EEG in 14 AS and 10 NTD subjects (age 15-28 years) using the same vibrotactile paradigm. Based on the scalp topographies, small sets of left hemisphere MEG and EEG sensors showing the maximum overall ITC were selected for group comparisons. Significant differences between the AS and NTD groups in ITC at 25 Hz as well as at 50 Hz were recorded in both MEG and EEG sensor data. For each measure, the mean ITC was lower in the AS than in the NTD group. EEG ITC values correlated with behaviorally assessed somatosensory sensation avoiding scores. The results show that information about ITC from MEG and EEG signals have substantial overlap, and thus EEG sensor-based ITC measures of the AS somatosensory processing biomarker previously identified using source localized MEG data have a potential to be developed into clinical use in AS, thanks to the higher accessibility to EEG in clinical settings.

Bilateral Representation of Sensorimotor Responses in Benign Adult Familial Myoclonus Epilepsy: An MEG Study.

Patients with cortical reflex myoclonus manifest typical neurophysiologic characteristics due to primary sensorimotor cortex (S1/M1) hyperexcitability, namely, contralateral giant somatosensory-evoked potentials/fields and a C-reflex (CR) in the stimulated arm. Some patients show a CR in both arms in response to unilateral stimulation, with about 10-ms delay in the non-stimulated compared with the stimulated arm. This bilateral C-reflex (BCR) may reflect strong involvement of bilateral S1/M1. However, the significance and exact pathophysiology of BCR within 50 ms are yet to be established because it is difficult to identify a true ipsilateral response in the presence of the giant component in the contralateral hemisphere. We hypothesized that in patients with BCR, bilateral S1/M1 activity will be detected using MEG source localization and interhemispheric connectivity will be stronger than in healthy controls (HCs) between S1/M1 cortices. We recruited five patients with cortical reflex myoclonus with BCR and 15 HCs. All patients had benign adult familial myoclonus epilepsy. The median nerve was electrically stimulated unilaterally. Ipsilateral activity was investigated in functional regions of interest that were determined by the N20m response to contralateral stimulation. Functional connectivity was investigated using weighted phase-lag index (wPLI) in the time-frequency window of 30-50 ms and 30-100 Hz. Among seven of the 10 arms of the patients who showed BCR, the average onset-to-onset delay between the stimulated and the non-stimulated arm was 8.4 ms. Ipsilateral S1/M1 activity was prominent in patients. The average time difference between bilateral cortical activities was 9.4 ms. The average wPLI was significantly higher in the patients compared with HCs in specific cortico-cortical connections. These connections included precentral-precentral, postcentral-precentral, inferior parietal (IP)-precentral, and IP-postcentral cortices interhemispherically (contralateral region-ipsilateral region), and precentral-IP and postcentral-IP intrahemispherically (contralateral region-contralateral region). The ipsilateral response in patients with BCR may be a pathologically enhanced motor response homologous to the giant component, which was too weak to be reliably detected in HCs. Bilateral representation of sensorimotor responses is associated with disinhibition of the transcallosal inhibitory pathway within homologous motor cortices, which is mediated by the IP. IP may play a role in suppressing the inappropriate movements seen in cortical myoclonus.

Auditory cues facilitate object movement processing in human extrastriate visual cortex during simulated self-motion: A pilot study.

Visual segregation of moving objects is a considerable computational challenge when the observer moves through space. Recent psychophysical studies suggest that directionally congruent, moving auditory cues can substantially improve parsing object motion in such settings, but the exact brain mechanisms and visual processing stages that mediate these effects are still incompletely known. Here, we utilized multivariate pattern analyses (MVPA) of MRI-informed magnetoencephalography (MEG) source estimates to examine how crossmodal auditory cues facilitate motion detection during the observer's self-motion. During MEG recordings, participants identified a target object that moved either forward or backward within a visual scene that included nine identically textured objects simulating forward observer translation. Auditory motion cues 1) improved the behavioral accuracy of target localization, 2) significantly modulated the MEG source activity in the areas V2 and human middle temporal complex (hMT+), and 3) increased the accuracy at which the target movement direction could be decoded from hMT+ activity using MVPA. The increase of decoding accuracy by auditory cues in hMT+ was significant also when superior temporal activations in or near auditory cortices were regressed out from the hMT+ source activity to control for source estimation biases caused by point spread. Taken together, these results suggest that parsing object motion from self-motion-induced optic flow in the human extrastriate visual cortex can be facilitated by crossmodal influences from auditory system.

Behavioral and Neurodynamic Effects of Word Learning on Phonotactic Repair.

Processes governing the creation, perception and production of spoken words are sensitive to the patterns of speech sounds in the language user's lexicon. Generative linguistic theory suggests that listeners infer constraints on possible sound patterning from the lexicon and apply these constraints to all aspects of word use. In contrast, emergentist accounts suggest that these phonotactic constraints are a product of interactive associative mapping with items in the lexicon. To determine the degree to which phonotactic constraints are lexically mediated, we observed the effects of learning new words that violate English phonotactic constraints (e.g., srigin) on phonotactic perceptual repair processes in nonword consonant-consonant-vowel (CCV) stimuli (e.g., /sre/). Subjects who learned such words were less likely to "repair" illegal onset clusters (/sr/) and report them as legal ones (/∫r/). Effective connectivity analyses of MRI-constrained reconstructions of simultaneously collected magnetoencephalography (MEG) and EEG data showed that these behavioral shifts were accompanied by changes in the strength of influences of lexical areas on acoustic-phonetic areas. These results strengthen the interpretation of previous results suggesting that phonotactic constraints on perception are produced by top-down lexical influences on speech processing.

Influence of unfused cranial bones on magnetoencephalography signals in human infants.

OBJECTIVE: To clarify the effects of unfused cranial bones on magnetoencephalography (MEG) signals during early development. METHODS: In a simulation study, we compared the MEG signals over a spherical head model with a circular hole mimicking the anterior fontanel to those over the same head model without the fontanel for different head and fontanel sizes with varying skull thickness and conductivity. RESULTS: The fontanel had small effects according to three indices. The sum of differences in signal over a sensor array due to a fontanel, for example, was < 6% of the sum without the fontanel. However, the fontanel effects were extensive for dipole sources deep in the brain or outside the fontanel for larger fontanels. The effects were comparable in magnitude for tangential and radial sources. Skull thickness significantly increased the effect, while skull conductivity had minor effects. CONCLUSION: MEG signal is weakly affected by a fontanel. However, the effects can be extensive and significant for radial sources, thicker skull and large fontanels. The fontanel effects can be intuitively explained by the concept of secondary sources at the fontanel wall. SIGNIFICANCE: The minor influence of unfused cranial bones simplifies MEG analysis, but it should be considered for quantitative analysis.

Distinct Regional Oscillatory Connectivity Patterns During Auditory Target and Novelty Processing.

Auditory attention allows us to focus on relevant target sounds in the acoustic environment while maintaining the capability to orient to unpredictable (novel) sound changes. An open question is whether orienting to expected vs. unexpected auditory events are governed by anatomically distinct attention pathways, respectively, or by differing communication patterns within a common system. To address this question, we applied a recently developed PeSCAR analysis method to evaluate spectrotemporal functional connectivity patterns across subregions of broader cortical regions of interest (ROIs) to analyze magnetoencephalography data obtained during a cued auditory attention task. Subjects were instructed to detect a predictable harmonic target sound embedded among standard tones in one ear and to ignore the standard tones and occasional unpredictable novel sounds presented in the opposite ear. Phase coherence of estimated source activity was calculated between subregions of superior temporal, frontal, inferior parietal, and superior parietal cortex ROIs. Functional connectivity was stronger in response to target than novel stimuli between left superior temporal and left parietal ROIs and between left frontal and right parietal ROIs, with the largest effects observed in the beta band (15-35 Hz). In contrast, functional connectivity was stronger in response to novel than target stimuli in inter-hemispheric connections between left and right frontal ROIs, observed in early time windows in the alpha band (8-12 Hz). Our findings suggest that auditory processing of expected target vs. unexpected novel sounds involves different spatially, temporally, and spectrally distributed oscillatory connectivity patterns across temporal, parietal, and frontal areas.

Overview of MEG.

Magnetoencephalography (MEG) is a method to study electrical activity in the human brain by recording the neuromagnetic field outside the head. MEG, like electroencephalography (EEG), provides an excellent, millisecond-scale time resolution, and allows the estimation of the spatial distribution of the underlying activity, in favorable cases with a localization accuracy of a few millimeters. To detect the weak neuromagnetic signals, superconducting sensors, magnetically shielded rooms, and advanced signal processing techniques are used. The analysis and interpretation of MEG data typically involves comparisons between subject groups and experimental conditions using various spatial, temporal, and spectral measures of cortical activity and connectivity. The application of MEG to cognitive neuroscience studies is illustrated with studies of spoken language processing in subjects with normal and impaired reading ability. The mapping of spatiotemporal patterns of activity within networks of cortical areas can provide useful information about the functional architecture of the brain related to sensory and cognitive processing, including language, memory, attention, and perception.

A neural mechanism of direct and observational conditioning for placebo and nocebo responses.

Classical theories suggest placebo analgesia and nocebo hyperalgesia are based on expectation and conditioned experience. Whereas the neural mechanism of how expectation modulates placebo and nocebo effects during pain anticipation have been extensively studied, little is known about how experience may change brain networks to produce placebo and nocebo responses. We investigated the neural pathways of direct and observational conditioning for conscious and nonconscious conditioned placebo/nocebo effects using magnetoencephalography and a face visual cue conditioning model. We found that both direct and observational conditioning produced conscious conditioned placebo and nocebo effects and a nonconscious conditioned nocebo effect. Alpha band brain connectivity changes before and after conditioning could predict the magnitude of conditioned placebo and nocebo effects. Particularly, the connectivity between the rostral anterior cingulate cortex and middle temporal gyrus was an important indicator for the manipulation of placebo and nocebo effects. Our study suggests that conditioning can mediate our pain experience by encoding experience and modulating brain networks.

Short timescale abnormalities in the states of spontaneous synchrony in the functional neural networks in Alzheimer's disease.

Alzheimer's disease (AD) is a prevalent neurodegenerative condition that can lead to severe cognitive and functional deterioration. Functional magnetic resonance imaging (fMRI) revealed abnormalities in AD in intrinsic synchronization between spatially separate regions in the so-called default mode network (DMN) of the brain. To understand the relationship between this disruption in large-scale synchrony and the cognitive impairment in AD, it is critical to determine whether and how the deficit in the low frequency hemodynamic fluctuations recorded by fMRI translates to much faster timescales of memory and other cognitive processes. The present study employed magnetoencephalography (MEG) and a Hidden Markov Model (HMM) approach to estimate spontaneous synchrony variations in the functional neural networks with high temporal resolution. In a group of cognitively healthy (CH) older adults, we found transient (mean duration of 150-250 ms) network activity states, which were visited in a rapid succession, and were characterized by spatially coordinated changes in the amplitude of source-localized electrophysiological oscillations. The inferred states were similar to those previously observed in younger participants using MEG, and the estimated cortical source distributions of the state-specific activity resembled the classic functional neural networks, such as the DMN. In patients with AD, inferred network states were different from those of the CH group in short-scale timing and oscillatory features. The state of increased oscillatory amplitudes in the regions overlapping the DMN was visited less often in AD and for shorter periods of time, suggesting that spontaneous synchronization in this network was less likely and less stable in the patients. During the visits to this state, in some DMN nodes, the amplitude change in the higher-frequency (8-30 Hz) oscillations was less robust in the AD than CH group. These findings highlight relevance of studying short-scale temporal evolution of spontaneous activity in functional neural networks to understanding the AD pathophysiology. Capacity of flexible intrinsic synchronization in the DMN may be crucial for memory and other higher cognitive functions. Our analysis yielded metrics that quantify distinct features of the neural synchrony disorder in AD and may offer sensitive indicators of the neural network health for future investigations.

Tracking reorganization of large-scale effective connectivity in aphasia following right hemisphere stroke.

In this paper we demonstrate the application of new effective connectivity analyses to characterize changing patterns of task-related directed interaction in large (25-55 node) cortical networks following the onset of aphasia. The subject was a left-handed woman who became aphasic following a right-hemisphere stroke. She was tested on an auditory word-picture verification task administered one and seven months after the onset of aphasia. MEG/EEG and anatomical MRI data were used to create high spatiotemporal resolution estimates of task-related cortical activity. Effective connectivity analyses of those data showed a reduction of bilateral network influences on preserved right-hemisphere structures, and an increase in intra-hemispheric left-hemisphere influences. She developed a connectivity pattern that was more left lateralized than that of right-handed control subjects. Her emergent left hemisphere network showed a combination of increased functional subdivision of perisylvian language areas and recruitment of medial structures.

Removing Cardiac Artefacts in Magnetoencephalography with Resampled Moving Average Subtraction.

Magnetoencephalography (MEG) signals are commonly contaminated by cardiac artefacts (CAs). Principle component analysis and independent component analysis have been widely used for removing CAs, but they typically require a complex procedure for the identification of CA-related components. We propose a simple and efficient method, resampled moving average subtraction (RMAS), to remove CAs from MEG data. Based on an electrocardiogram (ECG) channel, a template for each cardiac cycle was estimated by a weighted average of epochs of MEG data over consecutive cardiac cycles, combined with a resampling technique for accurate alignment of the time waveforms. The template was subtracted from the corresponding epoch of the MEG data. The resampling reduced distortions due to asynchrony between the cardiac cycle and the MEG sampling times. The RMAS method successfully suppressed CAs while preserving both event-related responses and high-frequency (>45 Hz) components in the MEG data.

Early Preferential Responses to Fear Stimuli in Human Right Dorsal Visual Stream--A Meg Study.

Emotional expressions of others are salient biological stimuli that automatically capture attention and prepare us for action. We investigated the early cortical dynamics of automatic visual discrimination of fearful body expressions by monitoring cortical activity using magnetoencephalography. We show that right parietal cortex distinguishes between fearful and neutral bodies as early as 80-ms after stimulus onset, providing the first evidence for a fast emotion-attention-action link through human dorsal visual stream.